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AUSTRALIA 
Patents Act 1990 

Vast Audio Pty Ltd 
PROVISIONAL SPECIFICATION 

Invention Title: 

Enhancement of sound externatization and separation for 
hearing-impaired listeners: a spatial hearing-aid 

The invention is described in the following statement: 
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Enhancement of sound externalisation and separation/or 
hearing-impaired listeners: a spatial hearing-aid 

aBttfltaaitiggflan 

This irrvention plates to providing spatial hearing for listeners wearing hearing-aids. More 
parti cul arty , the invention related to a method of; and equipment for, processing beari ng- aid sound 
signal bo that sound externalisation and sound separation Is improved. 

packgrow td to the Invention 

Listeners wearing all prior art hearing-aids demonstrate a substantial redaction in their sound 
externalisation and sound spatlaHsatlon and this in turn significantly reduces their ability to parse sounds 
of interest from competing background sounds. Nortnaily-hearing listeners, on the other hand, rely on 
their spatial hearing to separate conducting sounds based on their different spatial locations, Sound 
aparialisation also assists normally-hearing listeners to focus attention on sounds of interest. 

Human spatial hearing relies on the integration of acoustic information from the two ears. This 
acoustic information consists of the binaural difference in the intensity and time of arrival of sound 
between the two ears and also the rnonaural spectral cues mat result from the locatoWdependent acoustic 
filtering of sounds by the outer ear (see Yiriuai auditory space: Generation and applications* S. Carlile, 
Landes: Austin, 1996). The perception of externalised sounds (Le. t sounds that are heard as outside of the 
head) relies primarily on the monaural spectral cues provided by the acoustic filtering of the outer ear. 
Sounds without these spectral cues, but with a consistent imeraural time difference cue and intcrcural 
intensity difference cue, are perceived as latcrmlised and inside of the head. Because hearing-impaired 
listeners usually suffer greater hearing loss at the higher frequencies, the most difficult problem with 
spaEalisation tor these lUtenors when using hearmg-aids is me fact that the frequency range over which 
thcmonsarelspccr^ of 
the outer ear. see Human sound localisation of bandpass filtered noise, A. vanSchaikef a/., toil. J. of 
Neural Systems, p. 441-446, 1999). I^rrwenncnA his the very Wg^i frequencies greater than 8 kHz that 
are required tor accurate spatlalisarion of speech stimuli (see Speech Localisatio n , C . Jin et aU Free, of 
the 1 I2 a Conv. of the Audio Eng. Soc, May, 2002). 

The prior art discloses various means for enhancing the spatial hearing of listeners wearing 
hearing-aids. 

Some of the prior art methods for enhancing the spatial hearing of listeners wearing hearing-aids 
use miniature* completely-irj-me-canal (ClC) hearing-aids to avoid mlerference with the acoustic 
filtering of the outer car. The electronics for the ClC hearing-Bids are contained within a small mould 
that is completely contained within the auditory canal. 
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, to prior^tnethocfa forcnhEiictaithe .patiil heartog of listeners wearing hearmff-aids 
uso op«i or i«d- occhidSng ear 

cues (see AtofortflM^^ a Byrne 

Some of (he prior art methods to enhancing the ape** hearing of listeners wearing hesrmg*lds 

^□sttogatasoftto^^ 

InterauraJ Intensity dlfieiencecoes (see US Patent 5S70481). 

A disadvantage of all of the prior ait methods lor enhancing the spatial hearing of listeners 
wealing hearing-aids is that they do not use aignai procesaing to enhance and provide highrfrequenoy 
monaural spectral cues that vary cWstcntry with the location of the sound in apace. 

A disadvantage of ell of the prior art methods for enhancing the spaiiUheerlng of listeners 
wearing hcariiig-aida is that they do not make the very high fequency spectral cues <> 8kHz) more 



Terms related to this invention are defined here. 

The term "speech frequency band" is the frequency range (appro*irnalery and not exactly 
200 Hz to 4 Wfa) that Is empirically most irnportxni for a Uatener'a speech perception. It may vary 
slightly ton listener to listener and may be determined empirically anoVor analytically. 

The term Tiigh frequency sound component refers to a frequency component that occurs above 
the speech frequency band. 

The term "hie>-fi«quency bancT refers to the frequency band above the speech frequency hand * 



According to a first aspect of me mventiorw there is provided a method for enhancing the spatial 
hearing of listeners wearing a hearing-aid in either one ear <* bom cars, the method including the steps of 
applying aignai processing within the hearing-aid cither before or after the customary compression ami 
amplification signal pweessing of the hearm^aid, such mat the hipj>freqnency components (above the 
speech teiut^b^ofasound are compressed across frequency and/or shifted to lower frequencies, 
with or without loss of frequency mfmxnatien and with or without signal amplification. In such a manner 
that the speech frequency band is not disrupted or remains mostly undisrupted, and such that monsural 
spectral cues are available to the listener for sound externalisadan and spatJallsation. 



Accordi ng to a second aspect of the Inventi on, there i a ixovidcd a method for enhancing the 
spatial hearing of listeners wearing tearing^ds, the method mcludmg the steps of aspect one where the 
hearings is a ccmpleiely-uvmcH^nal (CIO hearing-aid mat preserves the normal acoustic filtering of 
the outer ear. 
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bearing of listener* wearing hearing-aid*, the method Including the steps of the first aspect end optionally 
the second aspect, where the high-frequency hearing range suitable for the listener's spatial bearing is 
individually and empirically determined lor the listener and die coinpresaion across frequency and/or 
shift to lower frequencies is oustanised to die ustenefe W^frequcney hearing range. 

According to a fourth aspect of tte 
spatial hearing of Usten^ 

possibly any of die steps of aspects two to three, where the high-frequency components of a sound are 
wmipresaed across frequency and/or shifted to lower frequencies, by first transforming the sound signal 
to the frequency demamusmgn^ 

band decomposition via filter bank processing, and then modifying the sound 's frequency domain 
representation by replacing the frequency components ftom / to £ (/ a > f x ) with frequency 
components from /, to /, ( f 4 >/,./, * fx > according to a mapping: 



According to a flJfth aspect of me invention, there is provided a method for enhancing the spatial 
hearing of listeners wearing hearing-aids, the method mchidmg the step* of aspect one and optionally 
any of the steps of aspects two to W, where the high-frequency components of a sound are compressed 
across frequency and/or shifted to lower frequencies using a mapping dud preserves, to some extent, the 
harmonic relationship between the sound's frequency coroponents, such as would occur when using the 
mapping of aspect four wtth /, - itf end/, - {n an integer). 

According to a sixth aspect of the invention, there is provided a method for enhancing me spatial 
hearing of listeners wearing hearing-aids, the method mohidmg the steps of aspect one and optionally 
any of the steps of aspects two to five, where the high-frequency components of a sound are compressed 
across frequency and/or shifted to lower frequencies using a wgairhttrmc compression such as that 
described by the ERB frequency scale or the BARK frequency scale as is commonly known wi Ihin me 
art. 

According to a seventh aspect of the invention, mere is provided a method for enhancing me 
spatial hearing of listeners wearing hearing-aids, the method including the steps of aspect one and 
optionally any of the steps of aspects two to six, where the high-frequency components of a sound arc 
compressed across frequency and/or shifted to lower frequencies only for those time windows in which 
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the sound signal contains substantial (as possibly determined by soma empirical criterion) high- 
frequency energy above the ipeech frequency band 

According to an eighth aspect of the invention, there is provided a method tor enhancing the 
spatial heeling of listeners wearing bearing-aids, the method including the steps of aspect one and 
optionally any of the steps of aspects two to seven, where die amplification of the high-frequency sound 
components is applied with consistent* or aa consistent as possible, relative gain across frequency for the 
high-frequency sound components. 

According to a ninth aspect of die invention, there Is provided a method for enhancing the spatial 
hearing of listeners wearing a hearing-aid in each ear (binaural hearing-aids), the method in eluding the 
steps of aspect one and optionally any of the steps of aspects two to eight, where the signal amplification 
of the high-frequency sound components is applied with consistent, or as consistent as possible, relative 
gain between die two ears for each frequency band 

According to a tenth aspect of die invention, there is provided an interface to disable the 
compression and/or sniffing to lower frequencies of the high-frequency sound components if or when the 
listener desires it 

According to an eleventh aspect of die invention, there is provided equipment for enhancing the 
spatial hearing of listeners wearing hearing-aids, die equipment including: 

a supporting means to house the hearing-aid electronics and components, 
an acoustic sensing means for recording acoustic signals, 
a sound delivery means for playing sounds to the eardrum. 

a signal processing moans for performing the required hearing-aid signal processing other man 
that described by mis invention, 

an energy detecting means and a controlling means to enable or disable frequency compression 
or frequency sMfting, 

a signal processing means to electronically compress across frequency and/or shift to lower 
frequencies the high-frequency sound components of the incoming sound within the hearing-aid. 

PrMP«si«p«»Q" oItitt£ngjBg 

Hie invention is now described by way of example with reference to the accompanying drawing 
in Figure 1 which shows, schematicaUy, equipment, in accordance with the invention, for enhancing the 
spatial hearing of listeners wearing hearing-aids. 
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In the drawing, reference numeral (1) generally designates equipment, in accordance with the 
invention, for enhancing the spatial hearing of listeners wearing hearing aids. The equipment includes a 
supporting means (2) to house the hearing-aid electronics end components, on acoustic sensing means (3) 
for recording acoustic signals, a sound delivery means (4) for plying sounds to the eardrum, a signal 
processing means (5) for performing me hearing-aid signal processing other than that described by mis 
invention, an energy dejecting means and a controUmg means (6) to determine if the high-frequency 
sound components contain energy above some pre- determined threshold and also control (enable or 
disable) the operation of the signal processing means (7% a signal processing means (7) to compress 
across frequency and/or shift to lower frequencies the rogjt-rrequenoy sound components of the incoming 



A preferred embodiment is given bete as an example. The equipment consisting of components 
(2) to (5) can be fashioned as a conmleeely-iTi-me-canal hearing aid; as is customary in the art In the 
preferred csnbcdirtvait there is a broadband (20 Hz to 20 kHz) sound receiver (3) that converts incoming 
sound waves in the ear canal into an electronic signal, in some embodiments of this invention, the energy 
detecting means (6) detects, as described in aspect seven* whether the incoming sound signal contains 
significant energy (above some threshold) in the high-frequency band above the speech frequency band, 
m the case that mere Is significant energy in the high-frequency band, the signal processing means (7) 
compresses across frequency and/or shifts to lower frequencies the Wgh-rrequency sound components of 
the tncoming sound signal as described in any of the aspects one to six. In the case that there is not 
significant energy m the high-frequency band or that the listener has decided to disable the frequency 
compression via unit (6> the signal processing means (7) passes the Incoming sound signal without any 
rnodiflcations to the rest of the hearing-aid's signal processing units (5). In the preferred embodiment, the 
corxmcnents (6) and (7) perform a pre-processing function and process the incoming sound signal prior to 
the customary commission and amplification processing mat occurs within hearing aids. In Figure 1 * the 
dashed line is drawn to indicate the separation of the pre-processing function of the signal processing 
units (6> and (7) from the main signal processing unit (5) of the hearing-aid* In the preferred 
embodiment, the amplification of die high-frequency sound components by the signal processing unit (5) 
is performed In such a way mat there is always a consistent, or as consistent as possible, relative gain 
across the frequency components of me high-frequency band, as described in aspect eight In die 
preferred embodiment hi which a hearing-aid is used in bom ears, the amplification of the high- 
frequency sound components by the signal processing unit (5) is performed in such a way mat there is 
always a consistent, or as consistent as possible, relative gain between the two ears for each frequency 
component within mo high-frequency band, as described in aspect nine. 

It is essential for this invention mat the hearing-aid preserves some form ofrnonaural spectral 
cues that vary systematically with the location of the sound source, m me preferred embodiment, flte 
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normal acoustic flitting of the outer car is preserved by using a ccrnpletdy-w-the-^ hearing-aid. In 
addirt<m,in the pwftrrrfembodhncnt, binaural listening cor^tious she uld be provided to tho hearing- 
aid listener. Either the listener ha* ( 1 ) a good unaided ear and int aided ei* or (2) two aidai ears. 

An advmtage of this invention U that the Mgh-fiwjuoncy spectral cues that vary most with 
directions in space (those above 8 kHz) are presented to the listener in en audible form. 

An advantage offtis invention is that because the auditory system has greater frequency 
resolution at the lower frequencies, foe frequency compression and/or frequency shift to lower 
frequencies that is described hi this invention win help compensate for toe hearing impaired listener's 
decreased frequency selectivity. 

An advantage of this invention is thai because the auditory system is capable of reiesraing 
monaural spectral ones for sound equalisation, the listener will be able to learn to use the altered 
spectral cues that result from the frequency compression and/or frequency shift to a lower frequency. 
Recent research has demonstrated that following a period of 20 to 30 days accomnxwfation, the human 
nervous system is able to use new spectral localisation cues to support control levels of localisation 
accuracy (see Hofr*m,P.M., J.G.A.V.Riswick,and AJ.V. Costal, Xekamlng sound localization vXth 
^eow.NauwNeuiosdenee. 1998. l(5):p.417-421>. The length of time necessary to adapt to these 
new cues is corrrperable to the time normally required to accommedato to conventional hearing aid. and 
also requires that the hearing impaired listener wear the hearing aid(s) consistently for relatively long 
periods at a time. 

An advantage of to invention is that it restores some degree of spatial bearing to the hearing 
impaired listener. This spatial auditory perception provides a basis tor Bpeech segregation to noisy 
acoustic environments. Unlike the speech enhancement technologies in other hearing aid systems, the 
"spatial hearing aid" described m this invention supports the segregation of multiple talkers from each 
omer as well as from other bsckground noises by eaplorang the binaural and spectral cues to the different 
locations of the sound sources. In addition, the restored spectral cues give rise to a clear percept of 
wrteraalized sound sources, which in turn maximircs the potential for information unmasking. It has 
been known for some time that the relative locations of competing sounds affect their ability to mask or 
interfere with (he understanding of speech (see Bronkhorst, A.W„ Tho cocHail pony phenowotu A 
review of reman* on speech intelagUXfity to multiple-talker conditions, Acustioa, 2000. 86: p. 1 17-128). 
What a talker and a masker (another talker or noise) are co-located, there is a reduction in the 
intelligibility of tho talker. When the maker is moved away from the target talker mere Is a release from 



inrprovement In the signal-to-noiseratio at one ear and (H) the diffatnee in the binaural differences of 
each sounds at bom earn. Recent research has also demonstrated that the perception of the different 
locations also plays a key rob in providing some unmasking: This additional increase In intelligibility 
has been attributed to the listener being better able to attend to and "stream out" the targe* talker from the 
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masking talker and is referred to aa faiftanoarioad The role of 

perceived spatial separation in the unmasking of speech, Journal of the Acoustical Society of America, 

1999. 106(6): p. 3578-358). 

An advantage of this invention is that it provides the basiB for locating die source of sounds) 

and therefore aids in normal acoustic navigation. 

An advantage of this invention is tot is makes use of the high frequency mformation provided 
by the fricatives and plosives of speech to aid in the spenalisation of the speech. 

An advantage of this invention is that it provides a means to optimise the utilisation of spatial 
mfbnnation by the hearmg-impalred listener by customising Hie higtt-fte*iency band to the 
listencn'opthnal high-frequency hearing range, 

It is anticipated that the m venrion win support spatial hearing hi most listeners with mild to 
mcoeratchearmg-hnpalnnent and who are able to wear aClC hearing-aid. 

It will be appreciated by persons skilled in the art that nurnecous variations and/or inodificatkms 
may be made to metoventlon as shown in the specific embodiments without departing from the spirit or 
scope of the mvention as broadly desmTxxL The present etnbodfarients are, therefore, to be considered in 
all respects as illustrative and not restrictive. 

Dated this Eleventh day of August 2003 

* i 

Secretary for Vast Audio Pty Ltd 



COMS ID No: SMBI-00372406 Received by IP Australia: Time (Han) 14:33 Date (Y-M-d) 2003-08-1 1 



08 '03 HON 15:30 FAX 461 2" 0351 2058 PHTSI0L0GY ©Oil 



9 




7 

Figure 1. 
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